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A new  approach  to  characterizing  the  problem 
of  implementing  linear  digital  filtering  operations 
on  finite-state  machines  is  presented.  In  this 
formulation,  the  implementation  of  shift-invariant 
or  shift-varying,  one-dimensional  or  multi-dimen- 
sional filters  as  single- input  or  multiple-input, 
time-invariant  or  time-varying  systems  are  all 
treated  in  the  same  framework.  This  framework  is 
based  on  the  representation  of  an  input/output 
specification  for  a linear  filter  by  a unique, 
possibly  infinite  transmission  matrix.  To  treat 
two-  or  higher  dimensional  filters,  the  concept 
of  transmission  matrix  is  extended  to  include 
arrays  of  higher  than  two  dimensions.  The  frame- 
work also  uses  matrices  whose  entries  are 
arrays  of  arbitrary  dimensions.  A set  of  notations 
and  operation  rules  for  these  arrays  and  matrices 
is  presented.  Within  this  framework,  all  possible 
implementations  of  a filter  are  characterized  as 
factorizations  of  its  transmission  array. 


The  actual  amount  of  storage  required  depends  on 
the  order  in  which  data  is  processed,  which  is 
not  specified  by  this  representation.  The  problem 
with  trying  to  characterize  implementations  of 
multi-dimensional  filters  by  a generalization  of 
this  type  is  that,  though  the  input  and  output 
data  structure  of  say,  a 2-D  filter,  is  different 
from  that  of  a 1-D  filter,  there  is  actually  no 
difference  between  the  inherent  structure  of  a 
machine  which  implements  1-D  filters  and  one 
which  implements  2-D  filters.  Thus,  rather  than 
having  two  different  descriptions  for  1-D  and  2-D 
filter  implementations,  one  common  framework 
should  suffice  for  all  filters,  regardless  of 
dimension. 


In  this  paper,  a framework  is  presented  which 
not  only  characterizes  all  possible  realizations 
(single  or  multiple  input,  time- invariant  or 
varying)  of  any  linear  filter,  but  also  treats 
shift- invariant  and  shift-varying  filters  of 
any  dimension  in  the  same  way.  Within  this  frame- 
work, a definitive  answer  is  given  to  the  question; 
what  constitutes  a realization  of  a multi-dimen- 
sional digital  filter?  Much  of  this  framework 
for  the  case  of  single-input-single-output  imple- 
mentations has  been  presented  in  15]  in  a less 
general  form. 


I . INTRODUCTION 


The  problem  of  finding  implementations  for 
linear  digital  filters  has  been  approached  in  many 
ways.  For  a given  realizcd^le  filter,  there  exist 
various  alternative  implementations.  However, 
there  has  been  no  common  framework  in  which  ail 
possible  realizations  for  any  filter  can  be  de- 
scribed. For  example,  though  it  is  possible  to 
describe  all  time-invariant,  single-input-single- 
output  realization  structures  for  1-D  shift-invar- 
iant filters  by  a signal  flow  graph  (1),  such  a 
graph  does  not  extend  naturally  to  include  many 
alternative  implementations  which  use  multiple  or 
block  inputs  (2,3).  Moreover,  the  signal  flow 
graph  is  only  capable  of  describing  time-invariant 
realizations  of  shift-invariant  filters,  and  does 
not  extend  naturally  to  shift-varying  filters. 


II.  DEFINITIONS  AND  NOTATIONS 


A digital  filter  may  be  defined  to  be  a rule 
for  transforming  digital  signals  within  a given 
class.  A digital  signal  may  be  any  countable  set 
of  nunfcers.  However,  usually  it  is  representable 
as  an  indexed  sequence  of  numbers,  where  the 
nun4)€r  of  indices  is  called  the  dimension  of  the 
signal.  The  dimension  of  the  signals  a filter 
transforms  is  in  turn  called  the  dimension  of  the 
filter. 


The  signal  flow  graph  has  been  extended  to 
characterize  2-D  filter  structures  by  including 

two  types  of  z ^ branches  [4J . However,  as  a 
characterization  of  implementations,  this  type  of 
flowgraph  is  even  less  attractive  than  the  1-D 
version,  since  it  fails  to  characterize  how  data 
actually  flows  through  an  implementation,  and  its 

z ^ branches  do  not  correspond  to  storage  cells. 


I:'  the  numbers  in  a digital  signal  were  re- 
garded to  have  continuous  and  unbounded  magnitudes, 
then  digital  signals  of  the  same  tyi>e  may  be  re- 
garded as  elements  of  a linear  function  space  with 
a countcible  basis,  A digital  filter  transforming 
such  signals  may  then  be  described  as  an  operator 
on  the  space.  In  particular,  a linear  filter, 
corresponding  to  a linear  operator,  would  be 
uniquely  describable  in  input/output  behavior  by  a 
possibly  infinite  array  of  numbers,  which  specify 
the  transformation  of  basis  elements.  This  array 
will  be  called  the  transmission  array  of  a linear 
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A digital  signal  can  also  be  described  as  an 
array  of  numbers.  The  number  of  indices  associa- 
ted with  each  entry  of  the  array  corresponds  to 
the  dimension  of  the  signal,  and  is  called  the 
dimension  of  the  array.  An  array  will  be  denoted 
by  a symbol  having  superscripts  and/or  subscripts, 
which  correspond  to  the  indices  associated  with 
each  array  entry.  These  scripts  may  be  any 
letters,  with  or  without  numerical  subscripts, 
provided  they  are  distinct  and  occur,  from  left  to 
right,  in  alphabetical  order  and  order  of  ascen- 
ding numerical  subscripts  among  similar  letters. 

The  size  of  an  array  is  given  by  the  numbers  of 
numerical  values  taken  on  by  the  indices.  As  a 
convention,  subscript  indices,  from  left  to  right, 
are  mentioned  before  superscript  indices,  also 
from  left  to  right.  For  example,  the  size  of  the 

array  a®*^,  where  0<s<2,  0<t<3,  0<j<5,  is  5x2x3. 

A slice  of  an  array  is  defined  to  be  a new 
array  formed  by  retaining  only  those  entries  where 
a subset  of  the  indices  take  on  certain  specified 
values.  To  denote  a slice  of  an  array,  the  indices 
given  specified  values  are  either  replaced  by 
these  values  if  they  are  numbers,  or  by  them 
enclosed  in  angular  brackets  if  they  are  symbols. 

For  example,  a ^ is  a 1-D  slice  of  the  3-D  array 
^ <mn>  ^ 

a"**  consisting  of  those  entries  of  a ^ where  s,t 

St  St 

take  on  the  values  m,n  r-^spectively.  Also,  b^  ^ 

denotes  the  entry  of  b^  with  values  3,4,i  for  its 
mn 

indices  m,n,s  respectively. 


If  two  or  more  arrays  have  the  same  super- 
scripts and  subscripts,  then  their  sum  is  defined 
to  be  an  array  with  these  seime  superscripts  and 
subscripts,  and  with  entries  equal  to  the  sum  of 
corresponding  entries.  If  two  or  more  arrays  do 
not  share  common  superscripts  or  common  subscripts, 
their  tensor  product  is  defined.  This  product  is 
said  to  be  uncontracted  if  no  symbol  appears  both 
as  superscript  in  one  factor  and  subscript  in 
another,  and  contracted  otherwise.  If  a symbol  is 
thus  repeated,  simimation  over  all  possible  values 
of  that  index  is  implied.  For  example. 


mn 


iP 


= I I 


<s>j 

®m<t> 


b 


<t> 

<s>p 


(1) 


This  is  the  well-known  summation  convention  due  to 
Einstein.  Each  summation  over  a repeated  index  is 
called  a contraction. 


The  tensor  product  takes  on,  respectively  as 
superscripts  and  subscripts,  the  combined  super- 
scripts and  subscripts  of  its  factors,  less  any 
repeated  symbols,  each  set  being  arranged  in 
alphedjetical  and  numerical  order.  Thus  an  uncon- 
tracted product  contains,  as  entries,  all  possible 
products  made  up  of  one  entry  from  each  factor 
array,  and  has  a dimension  equal  to  the  sum  of 
the  dimensions  of  its  factors.  A contracted  pro- 
duct is  similar  to  an  uncontracted  product,  except 
that  its  dimension  is  two  lower  for  each  repeated 
index,  because  of  contraction. 


It  should  be  clear  that  sum  and  tensor  pro- 
duct of  arrays  are  commutative  and  associative 
operations.  The  latter  is  also  distributive  over 
the  former.  We  shall  define  a non-commutative 
product  as  follows.  If  the  number  of  superscripts 
in  one  array  is  equal  to  the  number  of  subscripts 
in  another  array,  and  these  indices  take  on  corr- 
esponding ranges  of  values,  then  the  chain  product 
of  the  first  array  with  the  second,  in  that  order, 
is  defined  to  be  the  contracted  tensor  product  of 
the  arrays , formed  by  setting  the  superscripts  of 
the  first  array  equal  to  the  subscripts  of  the 
second,  and  keeping  the  other  indices  distinct. 


In  terms  of  the  notations  and  definitions 
developed  thus  far,  a 1-D  linear  digital  filter  is 
described  in  input/output  behavior  by 


where  is  the  transmission  array  of  the  filter, 
m 

and  x^,  y^  are  the  input  and  output  signal  arrays 

respectively.  Similarly,  a 2-D  filter  is  described 
by 


X. , 

mn  1] 


(3) 


Thus,  with  the  convention  that  signals  be  repre- 
sented by  arrays  with  subscripts  only,  and  trans- 
mission arrays  by  arrays  with  equal  numbers  of 
subscripts  and  superscripts,  the  output  of  a 
filter  is  given  by  the  chain  product  of  its  trans- 
mission array  with  its  input  array. 


Before  ending  this  section,  one  more  mathemat- 
ical entity  will  be  defined,  viz.  a generalized  ma- 
trix. It  is  defined  to  be  a matrix  whose  entries 
are  arbitrary  dimensional  arrays , such  that  those 
in  the  same  row  (column)  have  the  same  subscripts 
(superscripts) . Ordinary  and  block  matrices 
are  special  cases  of  generalized  matrices.  The 
sum  of  two  generalized  matrices  is  defined  in  the 
obvious  manner  if  corresponding  entries  in  the 
matrices  have  the  same  superscripts  and  subscripts. 
The  product  of  two  generalized  matrices  is  defined 
when  the  first  matrix  has  the  same  number  of 
columns  as  the  number  of  rows  in  the  second  matrix, 
and  the  number  of  superscripts  and  their  ranges  of 

values  in  each  entry  in  the  i*'^  column  of  the  first 
matrix  are  respectively  equal  to  the  number  of 

subscripts  and  their  ranges  in  the  i^^  row  of  the 
second  matrix,  for  all  i.  When  defined,  this  pro- 
duct is  computed  just  like  an  ordinary  matrix 
product,  only  that  the  products  of  individual 
entries  are  computed  as  chain  products  of  the 
arrays . 


It  is  convenient  to  have  an  abbreviated  connon 
notation  for  arrays  and  generalized  matrices. 

Thus,  we  shall  reserve  underlined,  possibly  sub- 
scripted capital  letters  to  represent  them.  When 
two  such  symbols  are  placed  side  by  side,  either 
the  chain  product  or  generalized  matrix  product  is 
implied.  Furthermore,  the  symbol  "O"  will  be 
reserved  to  denote  a zero  array  or  zero  general- 
ized matrix,  i.e.,  an  entity  with  all  entries  equal 
to  zero,  and  "r’  reserved  to  denote  a unit  array 
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realizable  filter  must  be  bounded- input-bounded- 
output  (BIBO)  stable,  since  the  output  array  ele- 
ments must  be  bounded  to  be  representable  by  a 
finite  number  of  digits,  and  if  the  filter  were 
not  stable,  every  error  tolerance  would  be  ex- 
ceeded by  some  output  point.  The  following 
theorem  characterizes  the  realizability  of  a 
filter  in  terms  of  its  transmission  array,  and  is 
stated  without  proof  because  of  space. 


or  unit  generalized  matrix,  defined  as  follows.  A 


unit  array  is  an  array  of  the  form  I 


<r,...r  > and  zero  otherwise.  A unit  generalized 
1 N 

matrix  is  characterized  by  unit  arrays  along  its 
diagonal  and  zero  arrays  elsewhere. 


Theorem  1 : A linear  digital  filter  is  real 
e if  and  only  if  it  is  BIBO  st£U)le  and  its 


III.  THE  NEW  FRAMEWORK 


transmission  array 
into  the  form 


The  realization  problem  for  linear  digital 
filters  may  be  stated  as  follows:  Given  the  input/ 
output  description  of  a filter,  find  an  algorithm 
which  realizes  this  filter  on  a finite-state 
machine  to  some  given  degree  of  accuracy.  The  ob- 
jective of  this  section  is  to  characterize  solu- 
tions to  this  problem.  We  shall  focus  attention 
on  realization  by  quasi-linear  machines,  defined 
as  follows. 


Definition  1:  A quasi-linear  machine  is  a 
machine  whose  operation  can  be  described  by  the 
equations 


row 


are  arrays  of  arbitrary  though  compatible  and 
bounded  dimensions  and  sizes,  whose  elements  are 
numbers  representable  by  a finite  number,  say  L, 
of  digits  each  (usually  binary  digits,  or  bits). 
The  symbols  Q and  @ denote  L-digit-precision 
products  and  sums  using  rounding.  The  number  L is 
called  the  word length  of  the  machine. 


are  arrays  of  arbitrary  though 

compatible  and  bounded  dimensions  and  sizes, 
with  entries  bounded  in  magnitude, 


In  (4) , the  subscript  k may  be  thought  of  as  a 
time  marker  for  the  machine,  which  operates  as 
follows.  At  k»l  the  first  operation  begins.  Then, 
at  each  subsequent  integer  value  of  k,  an  operation 
completes  while  a new  one  is  begun.  represents 

a set  of  numbers  fed  into  the  machine  at  time  k, 

^ represents  a set  of  numbers  retrieved  from  the 

machine  at  time  k+1,  and  ^ represents  a set  of 

numbers  stored  in  the  machine  at  time  k.  Realiza- 
bility of  a linear  digital  filter  may  now  be  de- 
fined as  follows. 


and  are  arrays  satisfying  the  following: 

1)  The  entries  of  F,  (G,  ) for  all  k corresponding 
-k  -k 

to  each  set  of  numerical  subscripts  (superscripts) 
are  all  zero  except  for  one  entry  in  one  F^  (^)  , 

which  equals  one;  2)  For  each  k,  all  but  at  most 
one  entry  of  (G^^)  corresponding  to  each  set  of 

numerical  superscripts  (subscripts)  are  zero. 


Definition  2:  A linear  digital  filter  is 
realizable  if  there  exists  a quasi-linear  machine 
and  an  order  of  enumerating  the  elements  of  the 
filter's  input  array,  such  that  given  any  e>0  and 
6>0,  there  is  a wordlength  L with  which  the  machine 
can  compute  any  element  of  the  filter's  output 
array,  in  finite  time  and  to  within  an  accuracy 
tolerance  of  e,  if  the  elements  of  the  input  array 
are  bounded  in  magnitude  by  6,  and  are  fed  into 
the  machine  in  the  order  mentioned  above. 


The  interpretation  of  the  generalized 
matrices  and  arrays  in  theorem  1 is  as  follows. 
The  matrix  £ represents  a mapping  of  the  possibly 
infinite  filter  input  array,  say  X,  into  a 
sequence  of  finite  arrays.  If  this  sequence  of 
arrays  is  denoted  X , # and  if  we  let  £ X “ 


The  par^uneters  e and  6 in  the  above  definition 
together  determine  the  dynamic  range  required  of  a 
realization.  Implicit  in  the  definition  is  that  a 
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VaR 


),  where  £j^  = 0,  then  the  action  of 

each  ^ may  be  regarded  as  converting  ^ to 
and  to  1^,  where  and  satisfy 


Q) , where  $,  is  the  reduced  transmission  factor 
-k 


corresponding  to  k=l,2. 


Unless  otherwise 


stated,  all  realizations  in  the  following  will  be 
in  this  form. 


r ; 


[ i 


^ + B.X 

-k+1  -k-k 


4 


k = 1,2,. 

£i  = o 


(9) 


The  rest  of  the  inputs  to  ^ are  left  unchanged  by 

it,  thus  :^... 1^2  X=  

k^l.  Now  if  in  (9),  ^ ^11 

bounded,  and  the  filter  is  BIBO  stable,  it  can  be 
shown  that  the  computation  of  (9)  can  be  performed, 
for  all  k eind  to  any  desired  accuracy,  by  a 
quasi-linear  machine  with  a sufficiently  long 
wordlength.  Thus,  using  this  machine,  any 
desired  element  of  the  filter  output  array  can 
be  found  in  the  array  2L  sufficient- 

ly large  k.  The  matrix  £ represents  a mapping  of 
the  outputs  of  the  quasi-linear  machine  into  the 
possibly  infinite  filter  output  array. 

Because  of  theorem  1,  every  realization  of  a 
linear  digital  filter  can  be  characterized  by  the 
following : 

Definition  3;  A realization  for  a linear 

i, . . . i 


digital  filter  with  transmission  array 


"N 


is  a set  of  generalized  matrices,  (P » • • • »£!  < 
satisfying  the  conditions  in  theorem  1,  such  that 

2 • 


n 

k=l 


-k 


(10) 


P and  2 called  the  I/O  matrices  and  the 
transmission  factors,  of  the  realization. 

Definition  4:  A realization  is  said  to  be 
regular  if  the  dimensions  and  sizes  of  the  arrays 

^'5k'^'5k 


in  k^l,  are  indepenf’ent  of  k. 


Theorem  2 ; To  every  realizable  linear  digited 
filter  there  corresponds  a regular  realization. 

Regular  realizations  are  interesting  because 
real  machines  generally  have  fixed-size  input/out- 
put channels  and  storage  capacities.  Since  the 
important  information  in  each  transmission  factor 

is  contained  in  the  finite  arrays  A.  ,B,  ,C.  ,D,  , 
*Hc  -ic  He  — k — k 

it  is  convenient  to  specify  realizations  in  terms 
of  these  arrays  only,  rather  than  the  entire  trans- 
mission factors.  Thus  we  shall  define  the  matrix 


^5, 

^5^ 


to  be  the  reduced  transmission  factor 


corresponding  to  and  specify  the  realization  in 
definition  3 alternatively  as  a set  lP»5.i»£2 ' * * ’ ' 


A realization  as  defined  represents  a scheme 
for  implementing  a filter  by  segmenting  the  input 
data  into  finite  portions  and  operating  on  one 
portion  at  a time.  Given  such  a scheme,  there 
remains  infinitely  many  ways  in  which  the  pro- 
cessing of  each  finite  portion  of  data  can  be 
accomplished.  In  particular,  any  factorization 
of  ^ represents  a way  of  performing,  by  a 


sequence  of  operations,  the  processing  by  the  k 
transmission  factor,  namely 


th 


^+1 


^k 


-k  -k 


(11) 


Thus,  a more  detailed  description  of  a realization 
is  the  following: 

Definition  5:  A realization  structure  for  a 


filter  with  transmission  array  . 


1 


of  generalized  matrices,  (P,{A  ,...,A.  .}  , ,0) , 

— -li  ^ 

where  A.,  is  of  laounded  size  and  $.  = A ...A 
-^1  —I 

is  well  defined,  such  that  • ‘2^  ® 

realization  for  the  filter. 


A useful  classification  of  realizations  and 
structures  follows. 

Definition  6:  A regular  realization  [P,$j^, 
^2'- ••'21  time-invariant  if  ^ is  independent 

of  k,  in  which  case  it  may  be  written  as  (£.<^,21  • 
A time-invaricuit  realization  structure  is  speci- 
fied in  the  form  (P.Aj^,*--,^  ,21- 

P 

Clearly,  given  a realizable  filter,  there 
exists  many  possible  choices  for  the  I/O  matrices 
P and  2^  Not  all  of  these  lead  to  practical 
realizations.  Given  two  I/O  matrices  which  sup- 
port a regular  realization,  all  possible  regular 
realizations  which  use  these  I/O  matrices  are 
related  simply  as  follows. 

Theorem  3 ; >^2  ’ ’ ‘ • '21  '5^2 ' ' ' ' ’ 

21  are  regular  realizations  for  the  same  filter 
if  and  only  if  there  exist  invertible  arrays  T^ , 

k«l,2,...,  such  that  ^ 

k-1,2,...  (12) 


r ^ 

-1 

T , 0 

T O 

-k+1  - 

-k  - 

0 I 

— — 

0 I 

L J 

. — 

♦k 


The  special  case  of  time-invariant  realization 
structures  is  worth  mentioning  as  a corollary  to 
theorem  3 . 
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Corollary  1;  Two  time-invariant  realization 
structures,  • <1^  >£1  3”'^  '2.^  ' 


realize  the  same  filter  if  and  only  if  an  inver- 
tible array  T exists  such  that 


T 0 

T ^ 0 

A ...A, 

-W  —1 

0 1 

2 

0 I 

— _ 

_ _ 

— — 

(13) 


Time- invariant  single- input-single-output 
structures  for  shift-invariant  filters  are  the 
type  of  realization  structures  that  have  been  roost 
often  studied.  A filter  with  transmission  array 

n . .is  said  to  be  shift-invariant  if 
^1' ■ ‘^N 

V 

^ depends  on  i and  only  through 

^1* ■ ■ ’n 

ij^-jj^,k=l, ,N.  That  is. 


1 : 
N 

3 


• m > 

.n">  -henever  i^-j^=tn^-n,^, 
N 


l<k<N  (14) 

The  slice  •••0  such  a filter's  transmission 
^1‘  ■ ‘^N 

array  is  called  its  impulse  response.  A shift- 
invariant  filter  is  classified  as  FIR  if  its  im- 
pulse response  has  a finite  number  of  nonzero 
entries,  and  HR  otherwise.  The  following  theorans 
consider  the  realizability  of  shift-invariant  1-D 
and  2-D  filters. 


Theorem  4 : A 1-D  FIR  filter  is  always 


realizctble . 


A 1-D  HR  filter  with  transmission 

,0  _j 


array  51^  is  realizable  if  and  only  if  f2 


is  a rational  function  of  z. 


<i> 

j=0  ^ 


Definition  7:  Let  the  impulse  response 
samples  of  a 2-D  shift- invariant  filter  be  ar- 
ranged equally  spaced  on  a planar  grid.  If  all 
the  nonzero  samples  lie  on  a straight  line,  then 
the  filter  is  said  to  be  degenerate . 

Theorem  5:  A nondegenerate  2-D  FIR  filter  is 
realizable  if  and  only  if  one  of  the  subscripts  of 
its  transmission  array  has  finite  range.  A non- 
degenerate 2-D  HR  filter  is  not  realizeible  unless 
one  of  the  subscripts  of  its  transmission  array 
has  finite  range. 


rV . AN  EXAMPLE 

Several  examples  of  single-input-single-output 
realization  structures  described  in  this  framework 
have  been  given  in  (5).  An  example  of  a time-in- 
variant realization  which  processes  4 input  data 
samples  at  a time  is  given  here.  Let  denote  a 
kxk  identity  matrix  and  0 a k^k  zero  matrix.  Then 
T ^ 

IQ  f*iQ)  is  such  a realization  for  the  1-D  FIR  fil- 
ter with  transmission  array  Q if 


Q = 


°2  °2  °2  °2 


Furthermore,  a realization  structure  can  be  con- 
structed by  noting  that  $ can  be  factorized  as 


°2  °2  ^2 


where  H defines  a cyclic  convolution  and  can  be 
further  factorized. 
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